3D Pose Refinement Using Rendering and Texture-Based Matching
نویسندگان
چکیده
This paper presents a method for accurately determining the pose of Lambertian rigid objects present in an image. An initial pose estimate computed with the aid of local point features is ameliorated by considering all visible object texture. This is achieved by combining a textured mesh model of the object with a graphics renderer to synthesize an image of the object as would be captured by the camera at a particular pose. A rendered image is compared against the acquired one with the aid of a visual dissimilarity score involving cross-correlation. Populationbased stochastic optimization is used to efficiently search the pose space and minimize the dissimilarity between rendered images corresponding to candidate poses and the acquired image. The method is demonstrated with the aid of real and synthetic images.
منابع مشابه
Automatic 3D model reconstruction based on novel pose estimation and integration techniques
An automatic three-dimensional (3D) model reconstruction technique is presented to acquire complete and closed 3D models of real objects. The technique is based on novel approaches to pose estimation and integration. Two different poses of an object are used because a single pose often hides some surfaces from a range sensor. A second pose is used to expose such surfaces to the sensor. Two part...
متن کاملInteractive Volume Rendering of Large Sparse Data Sets Using Adaptive Mesh Refinement Hierarchies
In this paper, we present an algorithm that accelerates 3D texture-based volume rendering of large, sparse data sets, i.e., data sets where only a fraction of the voxels contain relevant information. In texture-based approaches, the rendering performance is affected by the fill-rate, the size of texture memory, and the texture I/O bandwidth. For sparse data, these limitations can be circumvente...
متن کاملA novel constrained texture mapping method based on harmonic map
In this paper, we present a novel constrained texture mapping method based on the harmonic map. We first project the surface of a 3D model on a planar domain by an angle-based-flattening technique and perform a parametrization. The user then specifies interactively the constraints between the selected feature points on the parametric domain of the 3D model and the corresponding pixels on the te...
متن کاملPose Estimation of Two-Pose 3D Models Using the Base Tangent Plane and Stability Constraints
A pose estimation technique is presented to determine coarse registration parameters between two 3D models of an object. The models are reconstructed by merging multi-view range images of two different poses of the object, which is arbitrarily placed on a turntable. The result of pose estimation will facilitate registration refinement and integration of two 3D models. Registration refinement of...
متن کاملModel-Based Head Tracking and 3D Pose Estimation
This paper presents a generic method for addressing the issue of 3D model-based head pose estimation. The method proposed relies on the downhill simplex optimization method and on the combination of motion and texture features. A proper initialization based on a block matching procedure associated with 3D/2D matching depending on texture and optical flow information leads to an accurate recover...
متن کامل